Papers by Eva Sánchez Salido
Bilingual Evaluation of Language Models on General Knowledge in University Entrance Exams with Minimal Contamination (2025.coling-main)
Copied to clipboard
Eva Sánchez Salido, Roser Morante, Julio Gonzalo, Guillermo Marco, Jorge Carrillo-de-Albornoz, Laura Plaza, Enrique Amigo, Andrés Fernandez García, Alejandro Benito-Santos, Adrián Ghajari Espinosa, Victor Fresno
| Challenge: | Existing benchmarks for Large Language Models have been proposed as single-task evaluations, but they are not fully comprehensive. |
| Approach: | They present a bilingual dataset that contains 1003 multiple-choice questions in Spanish and English. |
| Outcome: | The proposed model ranking is almost identical to the one obtained with MMLU . |